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Summary of Review 



Five sister reports published by the Friedman Foundation over the past two years have 
ignored the relevant research literature in asserting that private-school voucher programs 
can reduce the social costs of dropping out while increasing graduation rates. The reports 
are state- specific, targeting five different states. But each report follows a parallel structure, 
arguing that the state in question overestimates its graduation rate, that the costs of drop- 
ping out are dramatic and that a private- school voucher program can increase graduation 
and address the dropout problem by generating competition. Yet the reports largely ignore 
the existing research literature on the personal and social benefits of educational attain- 
ment, the effects of school competition, and the factors associated with either completing or 
dropping out of high school. Further, each report does not provide sufficient information 
about how the author estimated the statistical claims made for each state, and the author 
fails to compare the alleged benefits of private-school vouchers with plausible alternatives, 
such as increasing public- school choice programs or improving graduation through other 
programs. State policymakers interested in increasing graduation would be better served by 
seeking out the available, well-researched scholarship on the topic. 
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REVIEW 



I. Introduction 

For almost half a century, school reform ad- 
vocates in the U.S. have pointed to high 
school dropout rates as a serious problem 
needing to be addressed. These advocates 
then contend that their proposals will be 
successful in reducing the individual and 
social costs of dropping out.' The list of re- 
forms proposed as dropout prevention, 
remediation, or amelioration include reme- 
dial education, vocational education, work- 
study programs, individualized counseling 
or social work, day-care for students with 
children, pre-school access, early-childhood 
and elementary-school interventions, mid- 
dle-school academic and behavioral inter- 
ventions, high school academic and behav- 
ioral interventions, expanding the curricu- 
lum beyond traditional academics, confirm- 
ing the central place of traditional academic 
curricula, retaining more students in a grade, 
reducing grade retention, requiring students 
to pass exams to earn a diploma, eliminating 
graduation exit exams, and quantifying and 
setting targets for graduation. 

In a series of reports sponsored primarily by 
the Milton and Rose D. Friedman Founda- 
tion, author Brian Gottlob has expanded the 
list of proposed solutions to include public 
funding for students to attend private 
schools — commonly known as voucher 
policies. Gottlob's argument in each report is 
that increasing competition through a 
voucher program will pressure all schools to 
improve outcomes, including a substantial 
increase in high school graduation. 

In all, the Friedman Foundation has pub- 
lished or co-published state-specific reports 
for five different states: Missouri, Indiana, 



Texas, South Carolina, and North Carolina.^ 
Each report follows a parallel structure, first 
offering crude estimates of the social costs 
of dropping out for that state, and then using 
a single article from the school choice litera- 
ture to estimate increases in graduation from 
the implementation of a voucher program 
and attendant savings for the state. 

All five reports use the existing literature on 
dropping out and school competition in a 
superficial way. In describing the urgency of 
the issue, the reports use cross-sectional 
comparisons of earnings and the social bur- 
dens of high school graduates and dropouts. 
That is, they look at a slice of the popula- 
tion, comparing the earnings of those with 
and without diplomas. While such cross- 
sectional analyses are commonly used in the 
public debate over dropping out, they are 
inaccurate for a variety of reasons that will 
be covered in some detail later in this re- 
view. While there are acknowledged social 
benefits to increasing educational attain- 
ment, the size of that benefit is a matter of 
vigorous debate. 

A deeper flaw in each report is the use of a 
single 1998 article written by Thomas Dee 
to calculate the alleged increase in high 
school graduation that would result if the 
state in question adopted a voucher pro- 
gram.^ That article is not a definitive study 
of school competition; the Friedman Foun- 
dation reports ignore the broader literature 
that provides (at best) mixed evidence of a 
competition effect on graduation. Even 
viewed in the most positive and forgiving 
light, this research suggests no more than a 
small effect. 

Einally, the reports fail to put the recom- 
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mendation for vouchers in the context of 
possible alternatives. Alternatives include a 
range of proposals to increase graduation 
including, if state policymakers are consid- 
ering school choice, public-school choice. 
Without a comparative analysis of alterna- 
tive proposals to increase high school 
graduation, the reports are of little practical 
use to policymakers who have no means by 
which to gauge the value of vouchers versus 
other alternatives. 

Readers of each report should be aware that 
this is a series of reports, with the details of 
the arguments changed in a formulaic man- 
ner for each state in question. While the first 
two of these reports were published only by 
the Friedman Foundation, the last three have 
been co-published with state-level advocacy 
organizations. 

II. Findings and Conclusions 
OF THE Reports 

The five reports were all published between 
March 2006 and October 2007. Each report 
makes the same argument: 

• The state’s high school graduation 
rate is too low. 

• There are social costs associated 
with low high school graduation, in- 
cluding lower tax revenues and 
higher costs of medical care and in- 
carceration. 

• Vouchers, or private choice, can in- 
crease the graduation rate through 
the effect of greater competition. 

The conclusion of each report is a recom- 
mendation that the state implement vouchers 
to increase the graduation rate and save re- 
sources for that given state. 



III. Rationales Supporting 
Findings and Conclusions 
OE THE Reports 

There are three main factual claims in each 
report concerning the extent of dropping out, 
the social costs of lower attainment, and the 
benefits of implementing statewide a pri- 
vate-school voucher program. 

Dramatizing Dropouts 

In each report, the first figure compares the 
report’s estimates of the state’s population 
aged 20-64 — primarily comparing those 
with no high school diploma, in contrast to 
those with a high school diploma, with some 
college experience, and various levels of 
higher education degree recipients. 

This approach — breaking down the rest of 
the population into a wide variety of sub- 
groups and comparing dropouts to each of 
these groups — incorrectly suggests that 
dropouts make up a very large portion of the 
overall population. In each report, the cap- 
tion for the first figure highlights the groups 
with smaller numbers than high school 
dropouts. In Texas, for instance, the first 
figure notes that there are more estimated 
dropouts than for any category of higher 
education degree recipients. In Missouri, 
dropouts only outnumber advanced degree 
recipients and associate degree recipients. In 
the South Carolina report, the bar graph is 
misleading: while there are fewer estimated 
dropouts (347,557) than college graduates 
(403,895) or those with some college ex- 
perience (454,847), the dropout bar extends 
further than the other bars. 

The next part of each report asserts that the 
given state underestimates the dropout prob- 
lem and overestimates graduation. Because 
the No Child Left Behind Act allowed each 
state to define a graduation rate, many states 
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composed measures that inflated any rea- 
sonable estimate of graduation."^ The reports 
use that fact to point out how the state in 
question reports inaccurate graduation rates; 
the reports also cite data on several meas- 
ures that present graduation rates lower than 
the state’s official measures. 

Illustrating Costs 

The next section of each report attempts to 
quantify the costs of lower attainment. In 
each case, the report contrasts cross- 
sectional data on the unemployment rate, 
income, use of Medicaid, and incarceration 
rates for dropouts, high school graduates, 
and residents with some higher education. 
For example, for Indiana, the state report 
asserts that high school graduates earn ap- 
proximately $10,000 more per year and have 
an unemployment rate more than 7% higher 
than any other group of state residents.^ 

Each report then aggregates the individual 
statistics to assert that the total cost of drop- 
ping out is the per capita difference in costs 
between dropouts and high school graduates 
(private income, lost taxes, increased bur- 
dens through Medicaid or prison) multiplied 
by the total number of dropouts in the state. 
Again for Indiana, the report estimates the 
total annual costs of dropping out to include 
$4.4 billion in lost wages, $150 million in 
lost tax revenue, $510 mi llion in additional 
Medicaid expenses ($190 mi llion from the 
state of Indiana), and $27 million annually 
in extra costs of incarceration. 

Justifying Vouchers 

The last section of each report attempts to 
estimate the benefits of increasing the pro- 
portion of state students in private schools. 
Each report refers to a single 1998 article 
that estimated the competitive effect on 
graduation to be an approximately 2% in- 



crease in graduation for each standard- 
deviation increase in private-school enroll- 
ments. Each report claims to replicate the 
study's methods in the state in question and, 
from that assertion and the costs described 
earlier, each report quantifies the number of 
students that would be necessary to increase 
private-school enrollments by a standard 
deviation, estimates the resulting increase in 
graduation, and calculates the benefits from 
the estimates set forth in the prior section. 

Again for Indiana, the state report claims 
that a replication of the 1998 study produced 
an estimated effect double that of the na- 
tional results, and that an increase in private- 
school enrollment of 56,000 students would 
result in between 2,000 and 4,000 additional 
graduates and a total annual saving of be- 
tween $5.8 and $11.8 million per year. The 
report then multiplies by 50 to arrive at a 
figure of more than $300 million over half a 
century. 

IV. The Reports’ Use oe 
Research Literature 

The claims in each report should be related 
to four different areas of research literature: 
the measurement of high school graduation, 
the private and social benefits of educational 
attainment, the effects of competition on 
educational outcomes, and the literature on 
high school graduation and dropping out. 
Each report makes reasonable if slim use of 
the literature in this last area: measuring 
high school graduation. But the reports fail 
to acknowledge the important questions or 
findings in the other three areas: the existing 
literature on the benefits of educational at- 
tainment, educational competition, and the 
factors shaping educational attainment. 

Measuring Graduation 

There is a growing literature on the prob- 
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lems of measuring graduation. Researchers 
and other observers generally agree that 
states have chosen a variety of measures that 
artificially inflate graduation statistics. 
These approaches include the inflation of 
diploma counts by including GEDs, the use 
of quasi-cohort measures that fail to adjust 
for transfer of students between schools or 
migration, and the use of administrative 
measures of dropping out (such as reports of 
school principals), when such counts histori- 
cally have missed substantial proportions of 
dropouts. The Friedman Foundation reports 
do cite a small part of the relevant literature. 
Yet even if they had chosen other available 
measures, the state dropout rates would not 
look much better.^ 

The Costs of Dropping Out 

Gottlob writes about the costs of dropping 
out, but he ignores the extensive, published 
debate among economists about the benefits 
of educational attainment and both the pri- 
vate and social costs of dropping out.^ A 
plurality of articles over several decades 
uses cross-sectional comparisons of income 
among people with different educational 
credentials to estimate the private benefits of 
attainment. These analyses are more sophis- 
ticated than the simple comparisons pre- 
sented in the Friedman Foundation reports, 
and economists recognize several complicat- 
ing factors in estimating the costs of drop- 
ping out. 

The largest point of controversy is over the 
meaning of a diploma: Is it an indirect 
measure of actual skills and knowledge ac- 
quired through education — an increase in 
human capitaP. Or is a diploma merely a 
credential unrelated to purported changes in 
human capital? Further, there are two con- 
trasting ways to view the diploma-as- 
credential. One holds that the diploma 
doesn’t really represent anything learned in 



formal schooling; instead, it helps identify 
people with certain desirable, intrinsic traits 
(such as intelligence, creativity, or persis- 
tence — what the proponents of this view 
see as permanent character traits) that have 
enabled them to attain the degree. The other 
viewpoint, however, holds that education 
simply replicates and enforces existing so- 
cial inequalities. Viewed this way, the cre- 
dential, the diploma, merely justifies a sort- 
ing process that would happen anyway in 
the labor market. 

These conflicting views make it more diffi- 
cult for economists to measure just how 
much a diploma benefits an individual, and 
even those who find a real human-capital 
benefit acknowledge that diplomas still 
function in part as a credential. To put it 
bluntly, if we could wave a magic wand so 
that everyone earned a high school diploma, 
the fact of universal graduation would not 
guarantee higher-paying jobs to all of the 
new graduates. 

A lesser point of controversy is a common 
confusion between the private and social 
benefits of educational attainment. On the 
one hand, the expected longer-term return in 
the form of a better-paying job may moti- 
vate many to continue in school, even at the 
cost of more immediate opportunities. But 
that is not enough to draw broader social 
conclusions about the benefits of education. 
Because of a limited supply of well-paying 
jobs, when many people try to improve their 
position in a competitive labor market, that 
competitive motivation does not translate in 
a simple way into greater productivity for 
the entire economy. 

On the other hand, the conflation of private 
with social benefits may mask benefits that 
only appear when looking at a population. 
When there is a critical mass of well- 
educated workers, companies may be more 
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inclined to move to that location, and the 
critical mass may create a broader synergy 
that would be invisible when looking at a 
simple aggregation of private benefits. Non- 
economic benefits may also be related to 
such externalities; if a critical mass of par- 
ents in a neighborhood makes sure their 
children read books, peer pressure may af- 
fect the behavior of other parents. 

Finally, there are continuing debates over 
the best methods to estimate income effects 
of even simple private benefits. Private 
benefits depend at least somewhat on mac- 
roeconomic conditions. A cross-sectional 
comparison of income confuses the effects 
of a single year’s economic conditions with 
the likely differences in lifetime earnings. 
One researcher who tried separating the two 
issues found that cross-sectional estimates 
may underestimate benefits when wages are 
generally rising and may overestimate bene- 
fits when wages are falling.^ 

None of these issues are addressed in the 
oversimplified presentation in the reports. 

School Competition 

While the research literature on the effects 
of competition in schooling is much smaller 
than the literature on the costs of dropping 
out, it is still substantially more established 
than the Friedman Foundation reports ac- 
knowledge. And there is no research con- 
sensus that greater competition fosters 
higher graduation rates. ^ 

From the literature, there are three reasons 
why one should be especially wary of the 
reports’ cherry-picking a single study as the 
basis for estimates of benefits from a pro- 
posed private voucher policy. One reason 
for skepticism is that estimates of alleged 
benefits vary considerably depending on the 
choice of data or the level of geographic ag- 



gregation for analyzing school markets. Ac- 
cording to Marlow’s 1997 article, the effects 
of school competition depends on whether 
you pick school district or county as the 
natural market for parents, and whether you 
choose a national sample of, e.g., 1988 
eighth graders followed up over the years or 
a different national database. When the con- 
clusions differ on the basis of such choices, 
no single study can be definitive. 

In addition to knowing about the instability 
of estimates, readers of the Friedman Foun- 
dation reports should be aware that the 
school-competition literature includes com- 
petition within the public sector as well as 
competition between public and private 
schools. The assumption of the report is 
that competition can only be increased 
through private- school vouchers, and that 
assumption is misleading. 

Furthermore, readers of the Friedman Foun- 
dation reports should know that the cherry- 
picked 1998 article relies on an estimate of 
high school graduation that the Friedman 
reports themselves criticize: Dee used ad- 
ministrative counts of dropouts to generate a 
synthetic dropout measure. Accordingly, the 
linchpin of the reports’ calculation is inferior 
to other studies that use national longitudinal 
data sets and individual-level data on at- 
tainment. 

Graduation and Dropping Out 

Finally, the reports make no mention of the 
extensive literature exploring graduation, 
dropping out, and the factors that shape edu- 
cational attainment. In doing so, each re- 
port treats the educational process as a black 
box, as if the reasons why students drop out 
of school are largely irrelevant to policy- 
makers. In that omission, each report ob- 
scures other program options that policy- 
makers could consider. 
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Several of those alternatives deserve greater 
scrutiny by state policymakers, including 
preschool education, comprehensive inter- 
vention programs in middle and high 
schools, changes in child labor laws, and in 
states with mandatory exit exams, modifica- 
tions of exit-exam requirements. 

IV. Review oe the Reports ’ 
Methods 

Previous sections of this review have dis- 
cussed weaknesses in the way that the 
Friedman Foundation reports ignored the 
literature on the benefits of educational at- 
tainment, the effects of school competition, 
and high school graduation, as well as the 
reports’ simplistic presentation of the costs 
of dropping out. Some additional concerns 
are warranted in terms of the reports’ failure 
to provide enough information about their 
estimation methods. 

In each of the reports, the author refers to 
unpublished calculations of the number of 
dropouts, the cross-sectional benefits of high 
school graduation, a local replication of the 
1998 school competition study, and the al- 
leged direct savings of a voucher program. 
In each case, the calculations would require 
considerable discretionary judgment in se- 
lecting data, choosing a method of calculat- 
ing graduation rates, weighting cases, and 
other issues that would, in sound scholar- 
ship, be described in detail either in the text 
of a report or in an appendix. In particular, 
the choice of a graduation measure has im- 
portant implications for statistical analy- 
ses. Without the publication of sufficient 
details, readers should not trust the factual 
claims about each state that is made in the 
reports, where detailed statistical algorithms 
are required, in the replication of the 1998 
study of school competition. 



V. Review oe the Validity oe the 
Findings and Conclusions 

The one trustworthy conclusion of each 
Friedman Foundation report — and a con- 
clusion that has been set forth in many re- 
cent scholarly analyses — is that states 
overestimate graduation and underestimate 
dropping out. In addition, the reports are 
correct in asserting that there are both pri- 
vate and social costs to dropping out, though 
the facile estimates in these reports are 
likely to be inaccurate. 

The reports’ conclusions about the benefits 
of school voucher programs are not trust- 
worthy, both because the reports ignore the 
existing body of literature on effects and 
also because they fail to provide sufficient 
information about the calculation of esti- 
mates. 

In addition, readers of each Friedman Foun- 
dation report should be aware that the rec- 
ommendation is not placed in the context of 
all policy options for increasing graduation 
and reducing the costs of dropping out. Even 
if the factual claims of the report were 
trustworthy, the relevant issue for policy- 
makers is to select from the best options for 
increasing graduation. Even within the realm 
of school choice, the report failed to ac- 
knowledge the potential for public-school 
choice to gamer much of the hoped-for 
competition benefits of a private-school 
voucher program. 

Responsible researchers acknowledge the 
complexity of dropping out as a phenome- 
non and the different options that need to be 
weighed against each other, including pre- 
school programs, reducing class sizes, and 
community-level intervention. 
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VI. Usefulness of the Reports 
FOR Guidance of Policy 
AND Practice 

Dropping out is generally acknowledged as 
a serious problem both for students who 
leave school and also for society. The 
broader social costs include economic penal- 
ties for lower educational attainment; costs 
associated with dependency; the potential 
damage to a democratic society of having a 
less-educated group of voters and jurors; and 
the damage to an egalitarian society when 
there are substantial differences in who 
graduates based on social class, race, ethnic- 
ity, and the presence and nature of disabili- 
ties. While the Friedman Foundation reports 
dramatically simplified the costs, they are 
real. 

State policymakers might be tempted to 
view the reports published by the Friedman 
Foundation as a rational response to such 



concerns. The weaknesses described in this 
review should make clear the problems with 
relying on any of these reports: the failure to 
respect the existing research literature in key 
topics, the failure to provide sufficient in- 
formation for readers to judge the conclu- 
sions, and the failure to put the proposed 
recommendation in a context of different 
options to improve graduation. 

State policymakers would be better advised 
to consult a report just issued by the Brook- 
ings Institution, entitled The price we pay: 
Economic and social consequences of in- 
adequate education}^ The book, edited by 
Clive Belfield and Henry Levin, more ap- 
propriately handles all of the issues identi- 
fied in this review. Moreover, the policy 
choices discussed in the Belfield and Levin 
anthology provide a more realistic basis for 
increasing graduation and reducing dropping 
out. 
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